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(54) Motion compensation encoding apparatus and motion compensation encoding method for 
high-efficiency encoding of video Information through selective use of previously derived 
motion vectors in place of motion vectors derived from motion estimation 



(57) In a video motion compensation encoding 
apparatus in which each of periodically selected pic- 
tures is encoded as successive blocks of picture ele- 
ments, by encoding of the prediction error amounts 
obtained for each biock in conjunction with variable- 
length encoding by a motion vector encoder (83) of 
motion vectors which are utilized in motion compensa- 
tipfi processing to derive the prediction error amounts, 
each of these motion vectors is selected by a compara- 
tor-controlled switch (14) either as an estimated motion 
vector derived by a conventional type of motion estima- 
tion section (15) or as a predicted motion vector derived 
by a motion vector prediction section (20) based on pre- 
viously encoded motion vectors, with the estimated 
motion vector being selected only if it is found that an 
amount of prediction error which would occur from using 
the predicted motion vector is signif icantiy greater than 
that which would result from using the estimated motion 
vector. A higher probability of encoding successively 
identical motion vectors is thereby achieved, resulting in 
greater encoding efficiency. 
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Description 

BACKGROUND OF THE INVENTION 

1 . ReM of the Invention 

The present invention relates to high -efficiency 
encoding of video information in the form of a stream of 
pictures expressed by a video signal, for the purpose of 
transmitting or storing the video information, whereby 
the pictures can be conveyed as a smaller amount of 
code than has been possible in the prior art. 

2. Desaiption of the Related Art 

Typical methods of high-efficiency encoding of 
video information which are widely used at present are 
the MPEG-1 or MPEG-2 standards, i.e. Moving Picture 
Experts Group international encoding standards which 
have been set by the lEC/ISO. With an MPEG encoding 
system, certain periodically selected pictures (transmit- 
ted as respective frames of a digital video signal, each 
picture being conveyed as an array of pixels each 
expressed by a digitized sample) are encoded by 
motion compensation, with each picture being encoded 
as a set of blocks of pixels. With motion compensation, 
a part of a preceding picture is shifted spatially, such as 
to to derive predicted pixel values for a block which is 
being encoded. The requisite amount and direction of 
that shift is expressed as a motion vector, which is 
derived by a process referred to as motion estimation. 
The respective differences between the actual pixel val- 
ues and the prediction values, referred to in the follow- 
ing as the prediction error values, are obtained and 
encoded using DOT conversion and variable-length 
encoding of the resultant coefficients. The motion vec- 
tors are generally derived for blocks of8x8or16x16 
element size, and the DCT generally applied to blocks 
of 8 X 8 values, however for simplicity of description it 
will be assumed In the following that the same block size 
(e.g.. 8x8 elements) is utilized in all encoding/decoding 
operations. 

Since it is necessary to use the prediction error 
amounts for the blocks in conjunction with the motion 
vectors for the blocks, at ti^e time of subsequent decod- 
ing, the motion vectors are also encoded. This is done 
by variable-length encoding, such as Huffman encod- 
ing, since the motion vectors do not generally change 
substantially between successive blocks of a picture. 

Fig. 11 is a general system block diagram of an 
^ example of a prior art type of motion compensation 
encoding apparatus which utilizes the above principles. 
In the following, when describing both this prior art 
example and embodiments of the present invention, 
only the encoding processing applied to those pictures 
which are encoded by motion compensation will be 
described. 

In Rg. 1 1 , a digital video signal from a video input 



terminal 1 is supplied to one input of a subtractor 2. In 
tiie following description of tiiis prior art example and 
also in the subsequent description of enixxliments of 
the invention, it is to be understood that such a digital 
5 video signal consists of successive digital samples 
expressing respective pixels, supplied to tiie input termi- 
nal 1 in the appropriate sequence for use by the encod> 
ing apparatus, i.e. so that successive blocks of pixels of 
a picture are operated on. A motion estimation section 
10 1 5 operates on the input video signal to derive respec- 
tive motion vectors for the blocks which are to be 
encoded, and supplies the motion vectors to a motion 
compensation section 8. As each pixel value of such a 
block which is being encoded is supplied to the subtrac- 
15 tor 2; a con'esponding prediction value Ibr that pixel is 
derived by the motion compensation section 8 and sup- 
plied to the other input of the subtractor 2, to thereby 
derive the corresponding prediction en-or value. The 
prediction values are generated ttirough motion oom- 
20 pensation by tiie motion conpensation section 8. i.e.. by 
shifting a reconstructed picture (supplied from tiie pic- 
ture memory 51) by an amount and direction specified 
by the corresponding motion vector, with that motion 
compensation typically using linear interpolation to 
25 achieve an accuracy of 1/2 pixel. The prediction error 
values thereby successively derived for the block are 
supplied to a DCT section 3. The DCT section 3 exe- 
cutes DCT conversion processing on tfiat set of pixels, 
i.e.. as a 2-dimensional (8 x 8) array of values, and sup- 
so plies the resultant set of DCT coefficients for the block to 
a quantizer 4. The quantizer 4 performs quantization of 
the DCT coefficients using a predetermined quantiza- 
tion step size, and supplies the resultant values to a var- 
iable-length encoder 5 and to a dequantizer 12. as a 2- 
35 dimensional array of quantized coefficients. 

The variable-length encoder 5 performs conversion 
of each of these 2-dimensional arrays to a 1 -dimen- 
sional set of values by array conversion, using zigzag 
scanning, with Huffman encoding then being applied to 
40 express the resultant sequence of values as runs of 
consecutive 0 values and runs of values other than 0. In 
that way, respective bit streams are derived for the pre- 
diction aror values of each of tiie blocks of a picture 
which is being encoded, and are successively supplied 
45 to a multiplexer 6, to be multiplexed witii bit streams 
which are derived by encoding the motion vectors which 
are derived for tiiat picture. The resultant code stream is 
supplied to a code output terminal 7. 

The dequantizer 12 and inverse DCT section 11 
50 perform inverse processing to tiiat executed by tfie 
quantizer 4 and the DCT section 3 on a block which is 
being encoded, to reconstruct the respective prediction 
error values for each of tiie pixels of the block As each 
such pixel prediction error value is thereby recon- 
55 structed, it is added in an adder 1 0 to a prediction value 
which has been derived by the motion compensation 
section 8 to thereby obtain respective reconstructed val- 
ues for each of tiie pixels of a picture, with resultant 
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reconstructed pictures being stored in the picture menv 
ory 51 . to be supplied to the motion compensation sec- 
tion 8. 

The motion vectors derived by the motion estima- 
tion section 15 are also supplied to a motion vector 
encoder 13. Typically, the motion vectors are derived to 
an accuracy of 1/2 pixel for each k)lock. 

\ The motion compensation section 8 receives from 
the picture memory 51 the pixel values of a previously 
encoded picture, i.e.. a picture which has been recon- 
structed, and which is to be used as a reference picture, 
selects a region of the reference picture that is deter- 
mined by the motion vector for a block which is being 
encoded, and successively outputs to the subtractor 2 
successive pixel values of that reference picture region, 
as a motion compensation prediction signal, to be sut>- 
tracted from the actual pixel values of the input video 
signal, and thereby derive the aforementioned predic- 
tion error values. 

Typically, the motion compensation section 8 will 
utilize linear interpolation in deriving the motion com- 
pensation prediction signal, enabling an accuracy of 1/2 
pixel to be attained for motion prediction. 

The motion vector encoder 1 3 compares the x and 
y-direction components of the motion vector of a block 
which is to be encoded with those of the motion vector 
of the immediately preceding encoded k)lock and per- 
forms Huffman encoding of the resultant difference val- 
ues, with the resultant bit streams being supplied to the 
multiplexer 6 to be multiplexed with the bit streams 
which are obtained for the prediction error values as 
described above. 

A decoding apparatus corresponding to the motion 
compensation encoding apparatus of Rg. 11 will be 
described in the following, referring to the general sys- 
tem blodk diagram of such a decoding apparatus which 
is shown in Fig. 12. Here, an input code stream which 
has been generated by the motion compensation 
encoding apparatus of Fig. 1 1 1s supplied to an input ter- 
minal 61 and Is separated by the demultiplexer 62 into 
the bit streams for the aforementioned prediction error 
values of respective (8 x 8) blocks of a picture which has 
been encoded by motion compensation and the bit 
striBams for the motion vectors which were derived for 
that picture. The prediction error value bit streams are 
restored to fixed-length code form by the variable-length 
decoder 63. and reconstructed prediction error values 
for respective blocks of a picture which Is being 
decoded are then obtained by the dequantizer 72 and 
the inverse DCT section 71. The respective prediction 
error values for pixels of a block which is being decoded 
are successively supplied to a adder 70. Predicted pixel 
values, derived by motion compensation, are supplied 
from a motion compensation section 78 to the other 
input of the adder 70, to thereby obtain reconstructed 
pixel values for the picture which is being decoded. 

These reconstructed pixel values are supplied to a 
output video terminal 64, and also to a picture memory 



52. to be temporarily stored for use as a reconstructed 
reference picture. 

The bit streams for the motion vectors are supplied 
to a motion vector decoder 65, which derives decoded 

5 nrxstion vectors, and supplies that information to the 
motion compensation section 78. The motion conpen- 
sation section 78 derives respective motion-compen- 
sated predicted pixel veilues. using the motion vector 
information supplied from the nxrtion vector decoder 65 

10 in conjunction with reconstructed reference picture val- 
ues supplied from the picture memory 52, and supplies 
these predicted values to the adder 70. It can be under- 
stood that the dequantizer 72, the Inverse DCT section 
71, the adder 70. the picture memory 52 and the motion 

15 compensation section 78 of this decoding apparatus 
respectively operate in the same manner as for the 
dequantizer 12. the inverse DCT section 11, the sub- 
tractor 10, the picture memory 51 and the motion com- 
pensation section 8 of the encoding apparatus of Fig. 

20 11. 

The motion vector bit streams which are separated 
from the Input code stream by the demultiplexer 62 are 
converted from variable-length encoding Ibrm to f ixed- 
lengtii code by the motion vector decoder 65. and each 

25 of the motion vectors which are thereby obtained is 
added to the motion vector obtained for the preceding 
block, to thereby obtain information specifying a motion 
vector for the block which is cun-ently being decoded, 
which is supplied to the motion compensation section 

30 78. 

With a prior art motion compensation encoding 
apparatus, the motion vectors which are obtained by 
motion estimation are directly encoded, without change. 
The operation of a motion estimation section such as 

35 the motion estimation section 15 of Fig. 11 serves to 
derive, for each block, the motion vector which will result 
in tiie smallest amount of prediction error. In that way, 
the anrx)unt of code which is generated as encoded pre- 
diction error values will be minimized. Howerer, there 

40 are many cases in which the derivation of such optimum 
motion vectors by motion estimation will result in an 
excessive amount of code being derived for the motion 
vectors.This is due to the fact that with variable-length 
encoding of the motion vectors, the amount of motion 

45 vector code which is generated (e.g. by tiie motion vec- 
tor encoder 13 of Fig. 11) is determined by the numbers 
of continuous runs of the same motion vectors. However 
if only the optimum motion vectors are always utilized, 
then even if the amount of reduction of prediction error 

so value code that would result from using a different 
motion vector for the current block (i.e., different from 
the motion vector derived for the preceding block) is 
very small, tiiat different motion vector will invariably be 
utilized. This can result in unnecessary amounts of 

55 motion vector code being generated, leading to a lower- 
ing of overall encoding efficiency 

Since there is no control of the amount of code 
which is generated by encoding the motion vectors, if 
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that amount become excessiveiy large, the amount of 
code which is generated from the prediction enor vai- 
ues will be suppressed. This problem is especially 
severe when the block size that is utilized for motion 
compensation is smallp and when highly accurate 
motion compensation is executed. 

SUMMARY OF THE INVENTION 

it is an objective of the present invention to over- 
come the above problems of the prior art by providing a 
motion compensation encoding apparatus for encoding 
an input digital video signal by processing in which peri- 
odic pictures expressed by the video signal are encoded 
by motion compensation encoding, whereby a motion 
vector is predicted for each of respective blocks of pic- 
ture dements of a picture which is to be encoded, with 
that prediction being based on motion vectors which 
have already been encoded, and whereby if there is no 
more than a predetermined difference between an 
amount of prediction error that results from using the 
predicted motion vector in motion compensation encod- 
ing of a block and the anx)unt of prediction error which 
results from using a motion vector derived by motion 
estimation to perform such motion compensation 
encoding, then the motion vector which is obtained by 
motion prediction is utilized for executing the motion 
compensation encoding. 

In that way a motion compensation encoding appa- 
ratus can be realized whereby the amount of code 
which is generated by encoding the motion vectors can 
be reduced, such as to reduce the overall rate of gener- 
ation of code by the motion compensation encoding 
apparatus. 

Furthermore with the present invention, it becomes 
possible to control the proportion of predicted motion 
vectors which are selected to be encoded and to be 
used in motion compensation processing (i.e.,to control 
the average rate of selection of predicted motion vectors 
rather than estimated motion vectors) in accordance 
with one or more operating conditions of the motion 
compensation encoding apparatus. Specifically, that 
confo) can be executed in accordance with the 
anrx)unts of code which are being successively gener- 
ated through encoding of the motion vectors. 

In addition, the invention provides a high-efficiency 
encoded recorded medium, having recorded thereon 
code expressing video information which has been 
derived as described above. 

Furthermore the Invention provides a method of 
motion compensation encoding, utilizing the principles 
described above. 

More specifically, according to a first aspect the 
invention provides a motion compensation encoding 
apparatus for converting a stream of pictures expressed 
by an input video signal into a code stream including 
encoded motion vectors corresponding to respective 
blocks of picture elements of said pictures, said blocks 



having been encoded by nriotion compensation, the 
apparatus comprising: 

nrx)tion estimation means for deriving, for each of 
5 said blocks, a corresponding estimated motion vec- 
tor. 

first error amount detection means for deriving, for 
said each block, a block prediction error amount 
which results from using said corresponding esti- 
10 mated motion vector to predict respective values of 
the picture elements of sakJ block by motion com- 
pensation prediction. 

motion vector prediction means for utilizing at least 
one previously encoded motion vector to derive a 
IS predicted motion vector for said each block. 

second error amount detection means for deriving a 
second block prediction error amount which results 
from using said predicted motion vector to predict 
sakJ values of the picture elements of said block by 
20 motion compensation prediction. 

comparator means for comparing said first block 
prediction error amount and second block predic- 
tion error amount to produce a comparison output 
indicative of a smaller one of said first block predic- 
ts tion en-or amount and second block prediction error 
amount, and 

selector means responsive to said comparison out- 
put for selecting one of said estimated motion vec- 
tor and predicted motion vector to be applied in 
30 motion compensation encoding of said each block 
and to be encoded as part of said encoded motion 
vectors. 

Such a motion compensation encoding apparatus 

35 preferably further comprises adjustinent . .means for 
adjusting at. least one of said first block prediction error 
amount and second block prediction error amount, prior 
to execution of said comparison by said comparator 
means, in a direction tending to make the second block 

40 prediction error amount smaller ttian the first block pre- 
diction error amount. In that way, the predicted motion 
vectors will tend to be selected more tiian tiie estimated 
motion vectors, i.e. ttie average rate of selection of pre- 
dicted motion vectors to be used in motion compensa- 

45 tion processing and to be encoded will be increased, 
with the increase being in accordance with tiie degree 
of adjustment provided by the adjustinent means. The 
adjustment can be performed for example by multiplying 
the block prediction error amount values obtained for 

50 tiie predicted motion vectors by a factor which is smaller 
than one, before executing the comparison with the 
block prediction error amount values obtained for the 
case of using the estimated motion vectors, or by sub- 
ti-acting a specific numeric value from the block predic- 

55 tion error amount values obtained for tiie case of using 
the predicted motion vectors. 

According to a second aspect, such a motion com- 
pensation encoding apparatus comprises code amount 
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calculation means for measuring amounts of code 
wHich are generated by said apparatus, and adjustment 
control means responsive to measurement results 
obtained by said code amount calcufation means for 
controlling said adjustment means such as to increase a 5 
degree of said adjustment when relatively large 
amounts of said code are generated, and to decrease 
said degree of adjustment when relatively small 
amounts of said code are generated. 

Alternatively, such a motion compensation encod- 10 
ing apparatus may include quantization means and 
quantization control section for generating a step size 
control signal to determine a quantization step size 
which Is utilized by said quantization means, with the 
apparatus further comparing adjustment control means is 
responsive to said step size control signal for controlling 
said adjustment means such as to inaease a degree of 
said adjustment when said step size is large and to 
decrease said degree of adjustment when when said 
step size is small. 20 

The invention further provides a motion compensa- 
tion encoding method for converting a stream of pic- 
tures expressed by a video signal into a code stream 
including encoded motion vectors, said motion vectors 
corresponding to respective blocks of picture elements 2s 
of said pictures, the method comprising: 

deriving, for each of said blocks, a conresponding 
estimated motion vector. 

deriving, for said each block, a block prediction 30 
error amount which results from using said corre- 
sponding estimated motion vector to predict 
respective values of the picture elements of said 
block by motion compensation prediction, 
utilizing at least one previously encoded motion 3S 
vector to derive a predicted motion vector for said 
X each block, 
deriving a second block prediction error amount 
which results from using said predicted motion vec- 
tor to predict said values of the picture elements of 40 
said block by motion compensation prediction, 
comparing said first block prediction error amount 
and second block prediction error amount, to find a 
smaller one of said first block prediction error 
amount and second block prediction error amount, 45 
and 

selecting, in accordance with a result of said com- 
parison, one of said estimated motion vector and 
: predicted motion vector to be applied in motion 
compensation encoding of said each block and to so 
be encoded as part of said encoded motion vectors. 

The present invention provides two basic advan- 
tages, with respect to encoding of motion vectors. 
Firstiy if a substantial increase in prediction en^or will 55 
not result from using a predicted motion vector (derived 
from motion vectors that have already been encoded) 
rather than using a motion vector derived by motion esti- 



mation, then tiie predicted motion vector will be utilized. 
This increases the probability that runs of kientical 
motion vectors will be encoded, thereby ensuring a 
reduction in tiie amount of code which Is generated by 
variable-length encoding of the motion vectors. 

Secondly it becomes possible to control the 
amounts of code which are generated from encoding 
the motion vectors. That Is to say, the invention enables 
the proportion of predicted motion vectors which are 
selected for use in motion compensation to be deter- 
mined based on a maximum permissible amount of pre- 
diction error which can be produced by encoding a 
block, with the degree of that permissible amount being 
set by the aforementioned adjustment factor. That 
adjustment factor can be fixedly predetermined at a 
suitable value, or can be controlled in accordance with 
changes in a rate of generation of code by the appara- 
tus, e.g., in accordance with the rate of generation of 
code by encoding tiie motion vectors. In that way the 
invention enables prevention of excessive amounts of 
code being generated by encoding of motion vectors. 
The adjustment factor may also be controlled in accord- 
ance with the value of quantization step size which is 
being utilized in quantizing ttie OCT coefficients 
obtained for the prediction error amounts of a block, to 
set the proportion of predicted motion vectors that are 
selected to a suitable value in relation to the quantiza- 
tion step size. 

Furthermore, the invention provides an encoded 
recorded medium having recorded thereon high-effi- 
ciency encoded information obtained by converting a 
stream of pictures expressed by a video signal into a 
code stream Including encoded motion vectors, said 
motion vectors corresponding to respective blocks of 
picture elements of said pictures, said encoded motion 
vectors having been obtained by: 

deriving, for each of sad blocks, a corresponding 
estimated motion vector, 

deriving, for said each block, a block prediction 
error amount which results from using said corre- 
sponding estimated motion vector to predict 
respective values of the picture elements of said 
block by motion compensation prediction, 
utilizing at least one previously encoded nrK>tion 
vector to derive a predicted motion vector for said 
each blocK 

deriving a second block prediction error amount 
which results from using said predicted motion vec- 
tor to predict said values of the picture elements of 
said block by motion compensation prediction, 
comparing said first block prediction error amount 
and second block prediction error amount, to find a 
smaller one of said first t}lock prediction error 
amount and second block prediction error amount, 
and- 

selecting, in accordance with a result of said com- 
parison, one of said estimated motion vector and 
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predicted motion vector to be encoded as part of 
said encoded motion vectors. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a general system block diagram of a first 
embodiment of a motion compensation encoding 
apparatus according to the present invention; 
Rg. 2 conceptually illustrates the selection of 
motion vectors derived by motion estimation and by 
motion vector prediction, while Fig. 3 illustrates 
possible methods of prediction; 
Fig. 4 is a block diagram of an example of the con- 
figuration of a nrx>tion vector encoder used in the 
embodiment of Fig. 1 ; 

Fig. 5 is a partial system block diagram showing a 
modification of the embodiment of Fig. 1 . whereby 
error amount adjustm ent is performed by subtracter 
rather than by factor multipiication; 
Fig. 6 is a block diagram showing an example of the 
configuration of an error amount detection section 
used in the embodiment of Fig. 1 ; 
Fig. 7 is a general system block diagram of a modi- 
fied version of the first embodiment in which 
amounts of code which are generated by utilizing 
respective prediction error amounts derived for a 
block are compared; 

Fig. 8 is a block diagram showing an example of the 
configuration of a combination of an error amount 
detection section and an encoding section, used in 
the apparatus of Fig. 7; 

Fig. 9 is a general system block diagram of a sec- 
ond embodiment of a motion compensation encod- 
ing apparatus according to the present invention, in 
which prediction en^or amount adjustment is varied 
in accordance with generated amounts of code and 
quantization step size; 

Fig. 10 is a partial system block diagram showing a 
modification of the embodiment of Fig. 9, whereby 
en-or amount adjustment is performed by subtracter 
rather than by factor multipiication; 
Rg. 11 is a general system block diagram of an 
example of a prior art type of motion compensation 
encoding apparatus; and 

Rg. 12 is a general system block diagram of an 
example of a prior art type of decoder apparatus for 
use in conjunction with the motion compensation 
encoding apparatus of Rg. 1 1 . 

DESCRIPTION OF PREFERRED EMBODIMENTS 

A first embodiment of a motion compensation 
encoding apparatus according to the present invention 
will be described in the following. Fig. 1 is a general sys- 
tem block diagram showing the configuration of this 
emljodiment. In Fig. 1, component which con-espond to 
component in the prior art example of Fig. 1 1 are indi- 
cated by identical reference numerals. This embodi- 



ment differs from Fig. 1 1 in that it includes en-or amount 
detectors 16. 19. an eTor amount comparator 1 7, a fac- 
tor multiplier 1 8, a motion vector switch 1 4 and a motion 
vector prediction section 20. while in addition, the oper- 

5 ation of the picture memory 9 is somewhat different 
from that of the example of Fig. 1 1 , and the embodiment 
preferatDly utilizes a motion vector encoder 83 which is a 
modification of the motion vector encoder 13 of Fig. 1 1 
as described hereinafter. This embodiment also differs 

10 from the prior art example in that an operation of judging 
nrrotion vectors is executed as described hereinafter, 
however the motion compensation encoding processing 
is identical to that of the prior art example. Hence, tiie 
operation of each of the video input terminal 1 , the sub- 

15 tractor 2. the DCT section 3, the quantizer 4,the varia- 
ble-length encoder 5, the multiplexer 6, tiie video output 
terminal 7, the motion compensation section 8, the 
dequantizer 12, the inverse DCT section 11 and tiie 
adder 10 of Fig. 1 is identical to that of ttie correspond- 

20 ing component of the prior art example. 

The motion estimation section 15 derives an esti- 
mated motion vector (designated in the following as 
MVe) for each block in the same way as for the prior art 
example, and supplies this to the en-or amount detec- 
ts tion section 16 and to one of the selection terminals of 
the motion vector switch 14. The motion vector predic- 
tion section 20 receives from the motion vector switch 
14 the successive motion vectors which are selected by 
the motion vector switch 1 4 to be encoded by the motion 

30 vector encoder 83 and utilized in motion compensation 
processing by tiie motion compensation section 8. and 
derives a predicted motion vector for the current block 
which is to be encoded, based upon the motion vectors 
which have been already encoded, with such a pre- 

35 dieted motion vector being designated in the following 
as MVp. 

The simplest method of motion vector prediction is 
to use as MVp the motion vector which has been 
obtained and encoded for the immediately preceding 

40 block, in the sequence of encoding successive blocks of 
a picture. In that case, the motion vector prediction sec- 
tion 20 can derive each predicted motion vector simply 
by delaying each input thereto by a time delay equal to 
tiie block encoding period, i.e tiie period of encoding 

4$ successive arrays of prediction error values for respec- 
tive blocks by the DCT section 3 etc. The predicted 
motion vector MVp for a block which is to encoded is 
supplied from the motion vector prediction section 20 to 
tiie error amount detection section 19 and to the other 

50 selection terminal of tiie motion vector switch 1 4. 

Rg. 2 iilusf ates tiie basis for using the estimated 
motion vectors and predicted motion vectors as 
described above. In Rg. 2, numeral 200 designates a 
part of a picture which is being encoded, with motion 

55 vectors of respective blocks designated by arrow lines. 
Assuming that block 203 is currentiy the block which is 
to be encoded, tiien 201 denotes the preceding block, 
for which a motion vector 202 was selected by tiie 
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motion vector switch 14 to be encoded and to be used 
in motion compensation processing of block 201. 205 
denotes a motion vector which is derived by motion esti- 
mation for block 203. while 204 denotes a predicted 
motion vector MVp which Is derived by the motion vec- 
tor prediction section 20 for that block In the simplest 
case as described atx)ve. the predicted motion vector 
204 may be made identical to the last motion vector to 
be encoded, i.e. motion vector 202. The basis of the 
Invention lies in the fact that in many cases, the motion 
vectors 204, 204 will be closely mutually similar. 

Motion compensation processing of the same type 
as that performed by the motion compensation section 
8 is applied for the block which is being encoded, by the 
error amount detection section 16 and by the error 
amount detection section 19 simultaneously, using the 
estimated motion vector MVe and predicted motion vec- 
tor MVp which are respectively derived for that block by 
the motion estimation section 15 and the motion vector 
prediction section 20. The motion compensation utilizes 
pixel values of a reference picture which are supplied 
from the picture memory 9. Each of the error amount 
detection section 16 and the error amount detection 
section 1 9 thereby derives an amount of prediction error 
for that block, with respect to the actual pixel values of 
the reference picture. The block prediction error amount 
(designated in the following as AEe) which is derived by 
using a motion-estimated motion vector MVe Is supplied 
from the enror amount detection section 16 to one input 
of the error amount comparator 1 7. The block prediction 
error amount AEp which is derived for that block as a 
result of using a predicted motion vector MVp is sup- 
plied from the error amount detection section 19 to the 
other input of the error amount comparator 17, after 
having been multiplied by a predetermined adjustment 
factor Kp, In the factor multiplier 18. The value of the 
adjustment factor Kp Is preferably approximately 0.9. 

The error amount comparator 17 compares the 
magnitudes of the block prediction en-or amount AEe 
and of the block prediction error amount AEp multiplied 
by-the factor Kp, and generates a comparison output 
signal 17a which takes either of two values in accord- 
ance with whetiier AEe or (Kp . AEp) is the smaller of 
the two, and applies that comparison output signal as a 
selection control signal to the motion vector switch 14. 
The motion vector switch 14 thereby selects either MVe 
or MVp to be used in encoding the current block in 
accordance with the following rule: 

if AEe < Kp.AEp, then the motion vector MVe is 

selected. 

if AEe > Kp.AEp, then the motion vector MVp is 
' selected. 

The motion vector which is thereby selected is used 
by the motion compensation section 8 to generate pre- 
dicted pixel values for that biocK and is also supplied to 
the motion vector encoder 83 and to the motion vector 



prediction section 20. 

The operation of the motion vector encoder 83 Is 
basically similar to that of the motion vector encoder 13 
of tiie prior art example, however It is preferable to con- 

5 figure the motion vector encoder 83 to derive succes- 
sive predicted motion vectors in the same way as is 
done by tiie motion vector prediction section 20. to 
obtain the difference between each such predicted 
motion vector and tiie motion vector which is selected 

10 by the motion vector switch 1 4 for tiie cun-ent block, and 
apply variable length coding to ttie differences thereby 
obtained. Fig. 4 shows an example of how the motion 
vector encoder 83 of tills embodiment could be config- 
ured. 

IS ' In the case of the simplest method of deriving the 
prediction motion vectors, described hereinatx)ve. the 
operation of tiie motion vector encoder 83 is essentially 
identical to that of the motion vector encoder 13 of the 
prior art example. 

20 Various metfiods of motion vector prediction are 
possible, as will be described referring to Fig. 3. It will be 
assumed tiiat a block X, of a set of blocks of a picture 
which is being encoded, is the block which is cun-entiy 
to be encoded, with ttie blocks being sequentially 

25 encoded as successive lines, from top to bottom, and 
from left to right, as viewed in Fig. 3. in that case, the 
simplest mettiod of prediction, as described above, is 
that in which the motion vector which was encoded for 
block B would be selected to be used for block X. How- 

30 ever another possible metiiod would be to derive a pre- 
dicted motion vector for block X based on a combination 
of the motion vectors which were selected for blocks A 
and B. I.e. two horizontally adjacent blocks. Alterna- 
tively, adaptive prediction coukJ be utilized, for example 

35 by selecting either the motion vector of a horizontally 
adjacent block or of a vertically adjacent block, as is 
appropriate. 

Furthermore apart from the method described 
above, of multiplying the block error amount AEp by the 

40 adjustment factor Kp for thereby adjusting that en^or 
amount, another possible adjustinent method would be 
to subtract an adjustinent value Mp from tiiat block enror 
amount, with tiie embodiment of Rg. 1 being modified 
as illusti-ated in the partial block diagram of Rg. 5, or to 

45 subtract an adjustment value from each of the error val- 
ues which are derived for respective pixels of a block. 
Assuming that the error value thereby derived for a pixel 
is a value in tiie range 0 to 255, the latter adjustment 
value could for example be made 1 or 2. 

50 Alternatively, instead of applying adjustment to the 
error amount AEp which Is derived by the error amount 
detection section 19. it would be equally possible to 
apply such adjustment by multiplying tiie error amount 
AEe that is derived by the error amount detection sec- 

55 tion 16, by a factor which is greater than one, e.g., 
approximately 1 .1 , or to add a suitable adjustment value 
to the error amounts which are obtained (using motion 
vector MVe) for respective pixels of the block being 
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encoded. Whichever method is used, adjustment must 
be applied in a direction such as to make the value of 
the error amount AEp (as supplied to the error amount 
comparator 17) smaller in relation to the error amount 
AEe. 5 

It can thus be understood that similar effects to 
those described above for the first embodiment can be 
achieved by utilizing such other methods of adjustment 
of the relative amounts of block prediction error. 

The error amount detectors 16, 19 can in general io 
each be configured such as to obtain the error amount 
for a block as the cumulative sum of the respective 
absolute values of motion compensation prediction 
error which are derived for the pixels of the block, or the 
sum of the squares of the respective prediction error is 
values obtained for these pixels. Fig. 6 is a block dia- 
gram showing an example of the configuration of the 
error amount detection section 16, for the case of abso- 
lute values being utilized. Here, a motion compensation 
section 100 receives an estimated motion vector MVe 20 
from the motion estimation section 15 and pixel values 
of a reference picture from the picture memory 9. and 
uses these to derive predicted pixel values for the block 
which is to be encoded, supplying these values to one 
input of a subtractor 1 01 . The actual pixel values for that 25 
block are supplied to the other input of subtractor 101 . to 
thereby obtain respective prediction error values for 
these picture elements, which are converted to respec- 
tive absolute values by an absolute value conversion 
section 102, with these values being summed by a so 
cumulative adder 103 to thereby obtain a total absolute 
value of the amount of prediction error for the block. 

The corresponding configuration for the error 
amount detection section 19 is identical to that shown in 
Fig. 6. but with the predicted motion vector MVp being 3S 
supplied to the motion compensation section 100. 

To attain a higher accuracy of judging the respec- 
tive error amounts which are obtained for a block, for the 
cases of using MVe and MVp respectively it is possible 
to use a more complex system configuration whereby 40 
the same encoding processing is executed as that per- 
formed by the OCT section 3, the quantizer 4 and the 
variable-lengtii encoder 5. That is to say. it becomes 
possible to derive the actual total amounts of code 
which would be derived for the case of using the esti- 45 
mated motion vector MVe and the predicted motion vec- 
tor MVp respectively to encode a block, and to compare 
these code amounts, after applying adjustment. Such 
judgement based on actual amounts of code is more 
precise than a judgement based upon only the amounts so 
of prediction error, however the necessary amount of 
processing is Increased. Fig. 7 is a general system 
block diagram of a modification of the first embodiment 
of Fig. 1 , whereby such actual amounts of code are 
derived and judged. In Rg. 7. error amount detection ss 
and encoding sections 36 and 39 each encode a set of 
prediction error values which are generated for tine block 
which is being encoded, i.e. respectively operating on 



the prediction error values which are produced in the 
case of using the estimated motion vector MVe and in 
tiie case of using the predicted motion vector MVp. After 
adjustment has been applied, e.g.. by multiplying by Kp 
the amount of code which Is generated by the error 
amount detection and encoding section 39. the result- 
ant code amounts which are generated by sections 36. 
39 are compared by the code bit total number compara- 
tor 37. and the resultant comparison signal 37a is 
applied to control the motion vector switch 14 in the 
same manner as described for tiie first embodiment of 
Fig. 1. 

The en-or amount detection and encoding section 
36 can be configured for example as shown in Fig. 8. In 
this case, the total number of code bits which is gener- 
ated for a blod<. as a result of variable-lengtii encoding, 
is obtained and is input to the code bit total number 
comparator 37. The configuration of tiie error amount 
detection and encoding section 39 is identical to that 
shown in Fig. 8, but witti the predicted nation vector 
MVp being supplied to the motion compensation section 
100. 

A second embodiment of the invention will be 
described, with Fig. 9 being a general system block dia- 
gram showing the configuration of this embodiment. In 
Fig. 9. component which correspond to component in 
Fig. 1 are indicated by kJentical reference numerals. 
The embodiment of Fig. 9 differs from tiiat of Fig. 1 by 
including a quantization control section 31. code 
amount calculation sections 32. 34. and an acQustment 
control section 33. In addition, the operation of tine fac- 
tor multiplier 18 is somewhat different from tiiat of the 
emlxxiiment of Fig. 1 . 

The code amount measurement section 32 moni- 
tors the overall amounts of code which are being gener- 
ated by the apparatus, and supplies corresponding 
information to the quantization control section 31. The 
quantization control section 31 establishes a suitable 
value for the quantization step size, in accordance with 
tiie detected amount of generated code, and supplies 
corresponding step size information to the quantizer 4 
and to the adjustment control section 33. e.g.. as a 
quantization step size command signal as shown in Fig. 
9. The quantization step size utilized by the quantizer 4 
is determined in accordance with that step size informa- 
tion. 

If the generated amount of code becomes greater 
tiian a predetermined target value so that it becomes 
necessary to reduce tiiat amount of code, tiien tiie 
quantization control section 31 causes the quantization 
step size is increased, while if the generated amount 
becomes smaller tiian tine target value tiien tiie step 
size is reduced. This is a conventional form of confol of 
quantization. 

The code amount measurement section 34 moni- 
tors the amount of code generated by motion vector 
encoding, and supplies corresponding information to 
tiie adjustinent control section 33. In addition, tiie quan- 
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tization step size information from the quantization con* 
trol section 31 is also input to the adjustment control 
section 33. The adjustment control section 33 deter- 
mines an appropriate value for the adjustment factor Kp 
in accordance with the amount of motion vector code s 
and quantization step size value, in combination, and 
generates a corresponding adjustment factor control 
signal 33a which is supplied to the factor multiplier 18. 
causing the factor multiplier 18 to set the value of Kp to 
the value which has been determined. io 

] As a result of controlling the adjustment factor Kp 
based on the generated amount of motion vector code, 
control is executed such that when the amount of 
motion vector code becomes excessively large, the 
adjustment factor Kp is reduced. In that way, since the is 
value of the error amount AEp which results from using 
a predicted motion vector MVp is reduced by such 
adjustment, there is a higher probability that the pre- 
dicted motion vectors MVp will be selected by the 
motion vector switch 14. As a result, due to the feet that 20 
variable-length encoding is utilized as described above, 
the amount of motion vector code will be reduced. 

; The reasons for controlling the adjustment fector Kp 
based on the quantization st^ size are as follows. The 
amount of code which is generated from encoding the 2s 
OCT coefficients of the prediction error amounts of a 
block will vary in accordance with the quantization step 
size. When the step size is small, i.e. finely detailed 
quantization is performed by the quantizer 4, a large 
amount of difference in the generated amount of code 30 
may occur as a result of only a small amount of differ- 
ence between successively obtained prediction error 
values which are supplied to the variable-length 
encoder 5. For that reason, when the quantization step 
size becomes small, this should tend to cause the value 3S 
of Kp to be brought close to 1 , i.e. to reduce the degree 
of adjustment which is applied to the prediction error 
amounts. Hence, the adjustment control section 33 
responds to the quantization step size information by 
increasing the value of Kp as the quantization step size 40 
becomes smaller. The actual value of Kp is thereby 
determined by the adjustment control section 33 based 
upon both the quantization step size and the amount of 
code which is generated by encoding the motion vectors 
(i.e.. the rate of generation of such code), with the rela- 4S 
five effects of these two parameters on the adjustment 
factor being a matter of design choice. 

The adjustment control section 33 can be config- 
ured using various known types of device, such as a 
read-only memory, so that detailed description will be so 
omitted. 

The embodiment of Fig. 9 can be modified in a sim- 
ilar manner to that described for the embodiment of Fig. 
1 and described referring to Rg. 7. such as to compare 
respective amounts of code which are generated from ss 
encoding the prediction error amounts of a block, as a 
result of using the M Ve and MVp motion vectors respec- 
tively In that case the quantization which Is performed 



in the error amount detection and encoding sections 36 
and 39. when encoding the prediction error amounts, 
should be controlled to use the same quantization step 
size as that of the quantizer 4. 

The invention also enables an improved high-effi- 
ciency encoded recorded medium to be obtained. This 
can be achieved by multiplexing the prediction enror 
value bit streams and motion vector bit streams which 
are obtained by the motion compensation encoding 
apparatus embodiment of Fig. 1 or of Fig. 9 with bit 
streams expressing audio and control information, 
using a multiplexing standard such as MPEG, adding 
enror-conrection codes to the result, and recording on a 
recording medium after modulation. 

In the case of a read-only type of recorded medium, 
the recording can be executed at high speed by using a 
stamper, etc. 

Basically it is possible to use a prior art type of 
decoding apparatus such as that of the example of Rg. 
12, to decode the code stream which is generated by 
the motion compensation encoding apparatus embodi- 
ment of Fig. 1 or of Fig. 9. However it must be ensured 
that the motion vector decoder 65 operates in accord- 
ance with any motion vector prediction which is per- 
formed within the motion vector encoder 83 of Rg. 1 , i.e. 
is configured to perform the inverse processing to that 
performed by the motion vector encoder 83. In the 
above description of the second embodiment of Rg. 9. 
it has been assumed that the adjustment of the respec- 
tive prediction error amounts that are derived based on 
an estimated motion vector MVe and a predicted motion 
vector MVp is performed by means of a multiplication 
factor Kp of value less than 1. acting on MVp. However 
it would of course be equally possible to use any of the 
other methods of performing such adjustment, such as 
multiplying MVe by a fector which is greater than 1 , etc., 
as described hereinabove for the first embodiment. 

From the above desaiption of embodiments it can 
be understood that with the present invention, a motion 
vector for a block which is to be encoded Is predicted 
from motion vectors which have already been encoded, 
and If the degree of prediction error which is produced 
when using the predicted motion vector for motion com- 
pensation of the block does not differ greatly from the 
degree of prediction error which results from using a 
motion vector derived by motion estimation, then the 
predicted motion vector is utilized for motion compensa- 
tion to encode the biocK thereby enabling the amount of 
code which is generated by variat>le-iength encoding of 
motion vectors to be reduced. 

Furthermore, due to the feet that a predicted motion 
vector is only utilized for motion compensation encoding 
a block when there is only a small difference between 
the amount of prediction error resulting from using that 
motion vector and the amount of prediction error which 
would result from using the estimated motion vector), 
this method of utilizing predicted motion vectors can 
cause only a slight overall Increase in the amounts of 
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code which are generated by encoding the prediction CI 
error amounts. That is to say. since that amount of 
increased code will in general be substantially less than i . 
the amount of decrease in generated code (lb. code 
generated by encoding of motion vectors) which results 5 
from using the predicted motion vectors, this enables a 
decrease in the overall amount of code which is gener- 
ated by the motion compensation encoding apparatus. 

Furthermore by varying the degree of adjustment 
which is applied to the prediction error amounts derived 10 
for a block by using the estimated motion vector and 
predicted motion vector respectively, and so thereby 
varying the proportion of predicted motion vectors 
which will be selected for use in motion compensation 
encoding, it becomes possible to control the degree of is 
code reduction (i.e., reduction of encoded motion vec- 
tors) which results from using the predicted motion vec- 
tors, and to thereby control the overall rate of generation 
of code by the apparatus. That is to say. the degree to 
which such a reduction in generated code can be 20 
achieved is determined by the maximum amount of pre- 
diction error which is permissjt>l6 for encoding each 
block. The encoding apparatus can thereby be 
designed to achieve a desired balance between the 
respective requirements for prediction error amount and 25 
reduction of generated code. 

In particular, it becomes possible to control the 
adjustment factor, and hence the proportion of pre- 
dicted motion vectors that are selected for use in motion 
compensation encoding, in accordance with detected 30 
levels of code which are generated by the apparatus, or 
in accordance with the quantization step size which is 
utilized in encoding the prediction error amounts 
derived for respective blocks (in the case of an appara- 
tus in which the quantization step size is variable), or in 3s 
accordance with some combination of these parame- 
ters. 

In a video motion conpensation encoding appara- 
tus in which each of periodically selected pictures is 
encoded as successive blocks of picture elements, by 40 
encoding of the prediction en-or amounts obtained for 
each block in conjunction with variable-length encoding 2. 
by a motion vector encoder (83) of motion vectors which 
are utilized in motion compensation processing to 
derive the prediction en^or amounts, each of these 4S 
motion vectors is selected by a comparator-controlled 
switch (14) either as an estimated motion vector derived 
by a conventional type of motion estimation section (15) 
or as a predicted motion vector derived by a nx)tion vec- 
tor prediction section (20) based on previously encoded so 
motion vectors, with the estimated motion vector being 3. 
selected only if it is found tiiat an amount of prediction 
error which would occur from using the predicted motion 
vector is significantly greater than that which would 
result from using the estimated nrwtion vector A higher 55 
probability of encoding successively identical motion 
vectors is thereby achieved, resulting in greater encod- 
ing efficiency 4. 



A motk)n compensation encoding apparatus for 
converting a stream of pictures expressed by an 
input video signal into a code stream including 
encoded motion vectors con^esponding to respec- 
tive blocks of picture elements of said pictures, the 
apparatus comprising: 

motion estimation means (15) for deriving, for 
each of said blocks, a corresponding estimated 
motion vector. 

first error amount detection means (16) for 
deriving, for said each block, a block prediction 
error amount which results from using said cor- 
responding estimated motion vector to predict 
respective values of the picture elements of 
said block by motion compensation prediction, 
motion vector prediction means (20) for utilizing 
at least one previously encoded motion vector 
to derive a predicted motion vector for saki 
each block, 

second en-a amount detection means (19) for 
deriving a second block prediction error 
amount which results from using said predicted 
motion vector to predict said values of the pic- 
ture elements of said block by motion compen- 
sation prediction, 

comparator means (1 7) for comparing saki first 
block prediction error amount and second block 
prediction error amount, to produce a compari- 
son output indicative of a smaller one of said 
first block prediction enror amount and second 
block prediction error amount, and 
selector means (14) responsive to said com- 
parison output for selecting one of said esti- 
mated motion vector and predicted motion 
vector to be applied in motion conpensation 
encoding of saki each block and to be encoded 
as part of said encoded motion vectors. 

The motion compensation encoding apparatus 
according to claim 1 . comprising adjustment means 
(1 8) for adjusting at least one of said first block pre- 
diction error amount and second block prediction 
error amount, prior to execution of said comparison 
by said comparator means, in a direction tending to 
make the second block prediction error amount 
smaller tiian the first block prediction error amount. 

The motion compensation encoding apparatus 
according to claim 2, wherein said adjustment 
means comprises factor multiplication means (18) 
for multiplying one of said first bk)ck prediction en-or 
amount and second block prediction enror amount 
by a predetermined factor (Kp). 

TTie motion compensation encoding apparatus 
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according to claim 2, wherein said adjustment 
means comprises subtracter means (94) for sub- 
tracting a predetermined numeric value (Mp) from 
\. one of said first block prediction error amount and 
second block prediction eror amount. s 

5. The motion compensation encoding apparatus 
according to claim 2. wherein said apparatus 
includes code amount calculation means (34) for 
measuring amounts of code which are generated io 
by said apparatus, and wherein said apparatus fur- 
ther comprises adjustment control means (33) 
responsive to measurement results obtained by 
said code amount calculation means (34) for con- 
trolling said adjustment means (18) such as to is 
Increase a degree of said adjustment when rela- 
tively large amounts of said code are generated, 
and to decrease said degree of adjustment when 
relatively small amounts of said code are gener- 
ated. 20 

6. The motion compensation encoding apparatus 
according to claim 2. wherein said apparatus 
includes quantization means (4) and quantization 
control means (31) for generating a step size con- 2S 
trol signal to determine a quantization step size 
which is utilized by said quantization means, and 

' wherein said apparatus further comprises adjust- 
ment control means (33) responsive to said step 
size control signal for controlling said adjustment ao 
means (18) such as to increase a degree of said 
adjustment when said step size is large and to 
decrease said degree of adjustment when when 
said step size is small. 

36 

7. An encoded recorded medium having recorded 
thereon high-efficiency encoded information 
obtained by converting a stream of pictures 
expressed by a video signal into a code stream 

• including encoded motion vectors, said motion vec- 4o 
tors corresponding to respective blocks of picture 
elements of said pictures, said encoded motion 
vectors having been obtained by: 

deriving, for each of said blocks, a con-espond- 4S 
ing estimated motion vector, 
deriving, for said each block, a block prediction 
error amount which results from using said cor- 
responding estimated motion vector to predict 
respective values of the picture elements of so 
said block by motion compensation prediction, 
utilizing at least one previously encoded motion 
vector to derive a predicted motion vector for 
said each block. 

deriving a second block prediction error ss 
amount which results from using said predicted 
motion vector to predict said values of the pic- 
ture elements of said block by motion compen- 



sation prediction, 

comparing said first block prediction enror 
amount and second block prediction error 
amount, to find a smaller one of said first block 
prediction error amount and second block pre- 
diction error amount, arvl 
selecting, in accordance with a result of said 
comparison, one of said estimated motion vec- 
tor and predicted motion vector to be encoded 
as part of said encoded motion vectors. 

8. A motion compensation encoding method for con- 
verting a stream of pictures expressed by a video 
signal into a code stream Including encoded motion 
vectors, said motion vectors corresponding to 
respective blocks of picture elements of said pic- 
tures, the method comprising: 

deriving, for each of said blocks* a correspond- 
ing estimated motion vector, 
deriving, for said each block, a block prediction 
error amount which results from using said cor- 
responding estimated motion vector to predict 
respective values of the picture elements of 
said block by motion compensation prediction, 
utilizing at least one previously encoded motion 
vector to derive a predicted motion vector for 
saki each blocK 

deriving a second block prediction error 
amount which results from using said predicted 
motion vector to predict said values of the pic- 
ture elements of said block by motion compen- 
sation prediction, 

comparing said first block prediction error 
amount and second block prediction error 
amount, to find a smaller one of said first block 
prediction en^or amount and second block pre- 
diction error amount, and 
selecting, in accordance with a result of said 
comparison, one of said estimated motion vec- 
tor and predicted motion vector to be applied in 
motion compensation encoding of said each 
block and to be encoded as part of sakl 
encoded motion vectors. 

9. The encoding method according to daim 8, further 
comprising: 

adjusting at least one of said first block predic- 
tion en^or amount and second block prediction 
error amount, prior to execution of said com- 
parison, in a direction tending to make said 
second block prediction error amount smaller 
than said first block prediction error amount 
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